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(57) Abstract 

A method and apparatus for controlling bh ratei used hi a moving picbxres encoder, such as an MPSG staiKlard encoder. A seqoence 
of movmg pictuiu3 is drvidcd bito ac^mcnis cQch of whSch composes ooe or more groop of pictores. A coosianl oyeraU bit tbib is specified 
for d^ sequence of piccuies, but variable bit rate encoding used within each segmeni. A difference between the number of bits allocsted 
for encoding the segmeixl and ibc actual bits used tor encoding is dctcnnined, nnd ihe dilTeicnce distributed over one or moie subseqiDent 
segmenl^. 
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MOVING PICTURES ENCODING WTTH CONSTANT OVERALL BIT^RATE 

Field of Che invenrion 

5 The pre^c invennan relates co a mediCNd and apparatus for encoding moving pictures. In 
pardcular, the present invention relates to a method and apparatus for performing variable 
bit rate control in a digital video encoder while maintaining a particular overall bit*raie. 

Background of die Invenripn 

10 

One of the main obstacles faced by industry dealing with digital video processing, storage 
and transmissioD is the large amount of data needed to represent analog video tn the digital 
domain. Accordingly, digital conipression is often applied to moving pictures to achieve a 
reduction in required transmission bandwidth or storage size. One variety of such 

15 compression techniques can be derived from the ISO/IEC MPEG Standards, the ISO/IEC 
11172-3 (MPEG-l), the ISO/KC 13818-2 (MPEG-2) and die MPEG-2 TM5 (test model 
5), developed by the Moving Picture E3q)en5 Group of the International Qrganisanon for 
Standardization. The disclosures of those standards documeni:s are hereby expressly 
incorporaced into diis specification by referee. MPEG-1 is the compression standard 

20 used in VidecCD while MPEG-2 is the video conqjuession standard used in DVD and 
noany digiml broadcasdng systems. 

The MPEG standards specify only the syntax of the compressed bitstreams and method of 
decoding. The method of implemenmtian in tte encoder is left to the developer, and any 
25 form of encoder may be employed as long as the resulting bitstream conforms widi the 
specified syntax. 

In certain applications such as video storage device (recorder), it is possible co use variable 
bit rate (VBR) encoding. A VBR encoder is able to vary its output bit-rate over a larger 
30 range than a CBR encoder, and this would generate an output which has a more constant 
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viaial quaUty. An example of a VBR encoder is described in United Stties patent number 
5.650,860. eadded 'Adapdve Quandzmion"- In order to malniain a maxiaiuin bit nue 
allowed by the target storage device as wcU as an overall bit-rate which enables Input 
picture sequence to be stored Into a defined storage space, such VBR encoders uilUse 
5 multiple encoding passes. 

In the first encoding pass, the bit uiilisaiion infbimaiion is determined for each scene or 
each picmre in Ae input sequence. This may be done by fixing die reference quantisation 
step size and disabling the VBV connoi. The determined bit utilisation information \s ±m 
10 used to generate a bit budget for each scene or picture such that an overall target number 
of bits to code die sequence is fixed, and that the maximum bit rate is not violated. In 
cases dial bit udlisadon information obtained is not dose to that required for generating 
die bit budget, steps from die first coding pass must be repeated with an adjusted reference 
quantisadon swp-sia. The input sequence is coded in a final pass using die generated bit 
15 budget infbtmanon to achieve the target bits or overaU bit rate. 

Multiple-pass VBR encoders requires large storage memory for intermediaie bit udlisadon 
infoimaiion, and large computation needs far the addidonal passes and bit budget 
gcoerarion. Furdiermore, such a VBR encoder cannot process input sequences In real-time 
20 as r«quiied by certain applicanons. 

Summary of the Invention 

It is an object of die piesent invention to provide a single-pass real-time variable bit rate 
25 encoder for moving picwies. It is also an object of the present invention to provide 
variable bit rate encoding of moving p'ctutes such diat die change in encoded pictute 
quality from one scene to anodicr is tninimised. A ftirtiier object is to provide a real-dme 
variable bit rate encodtng algoridim which produces a constant overall bit rate. 

30 In particular, the present invenrion encodes an input movuig picmre s sequence one 
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segroem: ac a time according to a target enoxling qaalhy which is detennined by a target 
segmenc bit rate. The target segment hit rate of a current segment is preferably derived 
from the differences bccwem the target segment bit raies and the acmal coding bit rarcs of 
previous or previous few encoded segments. 

To maintain consistent encoding quality for aO picrates witlun a segment, die actual target 
bit rate for encoding the pictures is made variable according to their scene complexides as 
well as the target encoding quality of die segment. 



to As the target encoding quali^ of each segmrai is modified based on cfac differences 
between the target and the actual bit rates of previous or previous few encoded segments, 
±e change of targ« oicoding quality from segment id segment is made relatively smooth 
conqiared to that of a Constant Bit-Rate Encoder, and fuiibennore^ the overall bit raie of 
encoding is maintained constanL 

15 

In accordance widi die presttii invention, there is provided a method for use m a moving 
pictures encoder for encoding a sequence of segments each having at least one image, 
comprisiag the steps of: 

a) determining an overall target bit rate for encoding the sequence of images; 
20 b) derermining a bit allocation and target quantisation step size for encoding a 

ftrst segment on dse basis of a segment target bit rate calculated using said overall 

target bit rate; 

c) oicodlng said first segment usitig a variable bit rate er^oding method 
according u> the target quantisation step size; 
25 d) determining a difference between the number of bits used to encode said 

first segment and said first segment bit allocadon; 

e) distributing said difference for use in encoding at least one subsequent 
segment to determine a subsequent segment bit allocadon; 
0 determining a new target quantisation step size for encoding a said 
30 subsequent segim^ on die basts of a new target segment bit race calculated using 
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said segnxem target bit rate and the distributed difEerence; and 

g) encoding said subsequent segment using a variable bit rate encoding method 

according to die new target quanilsanon step size; 

wherein variable bit rate encoding is employed for encoding picnires wlihin a 
5 segment whilst maimaining a substantially constant bit rate over said seqoence- 

Tbe present btvendon also provides a mediod for encoding moving picGures in a moving 
pictures ecu^oder wbendn a sequence of images are provided as Liq>ut, die sequence of 
images comprising a plurality of segments each having a plurality of images, the mecbod 
10 including: 

a) deteimining an overall target bit rate for encoding the sequence of images; 

b) maintaining a distribudon record of bits trom at least one previously 
encoded segment allocated for use in encoding at least one segment to be encoded; 

c) determining a target segment bit rate for a segment of die sequence of 
IS images on the basis of the overall target bit rate and a bit rate change calculated 

from die corresponding allocated bits from the distribution record; 

d) determining a target segment encoding quality from the target segment bit 
rate, a preceding target segment bit rate and a preceding target segment encoding 
quality,; and 

20 e) encoding die images of segment according to the target seg m ent 

encoding quality using a variable bit rate eticoding technique taking into account 
scene comple3dties of the images in the segmeni; 

wherein n^ainratning said distribudon record includes determining a difierence 
between the number of bits used to encode a pardcular segment and the number of bits 
25 allocated for encoding the particular ^gment on the basis of die target segment encoding 
quality. 

According CO the current invention, a moving pictures sequence is divided into segments. 
The size of each segment may be ^icabiy determined. Each segment is encoded widi a 
30 target encoding quality derived Itom its target segment bit rate. A variable bit race (VBR) 
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encoder is utilised to eticode die segment according to its target encoding quality- 

Tte target segment bit rate of an initial segment is obtained from aiiser defined target 
overall bit rate- After encoding the segment, the difference between die actual bit rate 
5 used and the target segment bit rate is obtained. This difference Is propagated to die next 
or next few segmetns lo be coded. This process is repealed for each segment; dierefore, 
for each subsequent segment, a new target segment bit rare is detennined from die user 
defined target overall bit rare and die differences between die target segment bit rates and 
actual bit rates of previous or previous few segm»ts. 

10 

The present invention further provides a mediod for controlling bit allocation in a moving 
picmres encoder for encoding a setjuence of images conqarising a plurality of segments 
each having a phirality of images, the raediod inchiding, for each segment: 

deiennining a difference between a number of bits used for encoding a previous 
15 segment and a number of bits allocated for encoding die previous segment; 

calculating a bits distribution from die determined bits difference and a 
predetermined discribudon function; 

calculating a bit rare change from die bits disiriburion and a predetermined number 
of un^es in the segment; 
20 calculating a target segment bit rate from the hit rate change and a predetermined 

target overall bit rate for the sequence of images; and 

determining a target segmeitt encoding quality from the target segment bit nue. 

The present invention fiirther provides an encodnig quali^ adjusa»nt processor for 
25 generating a target segment encoding quality value in a moving pictures encoder for 

encoding a series of segments each having at least one image using a variable bit rate 

encoding scheme whilst maintaining a substandally constant overaU bit rate, comprising: 
a bits difference computation means coupled to receive a segment encoding bit 

utilisation value and a target segment bit rate and generate therefrom a bits difference 
30 value represenung a difference in bits allocated and bits used for encoding a agment: 
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a bics distribution mpan< coupled to the bits ^i^ence coiiq)uiaiion means for 
computing ai least one bits distribudon value from the bits difference value and a 
predeiemtined distribution function; 

a bit rate difiereoce compucadon means coupled to tfae bits distribution means for 
5 computing a segment bii rate difference from the at least one bits distribution value and a 
predetermined number of images in a segment; 

a target segment bit rare adjusmient means coupled to the bit rate difference 
computation means and ttie bits difference computation means for confuting said target 
segment bit rate from the segment bit rate difference and a predetermined target overall bit 
10 rate for the sequence of segments; and 

an encoding quality computation mftins coupled to tiie target segment bit rate 
adjusonent mpsnvt tor computii^ a tar^ segment encoding quality value from said target 
segment bit rate, 

1 5 The present imrexition further provides a moving pictures encoder comprising: 

a coding processor for encoding picture data based, on macrobiocks according to a 
quantisation step ^ze; 

a virtual buffer processor coupled tn the coding processor for tracking a immber of 
bits used for encoding successive macrobiocks in a picture and a number of bits used for 
20 encoding successive piauies in a group of pictures; 

a quantisation step size processor coupled to the coding processor for determining 
said quantisation step size from a target number bits allocated for a picmre and the number 
of bits already used for encoding macrobiocks in char picture; 

a picture bit allocation processor coupled to the quantisation step size processor for 
25 determining said target number of bits allocated for a picture from a target bit rate and the 
number of bits already u^ for encoding pictures In a current group of plcmres; 

a bit rate adjustment processor coupled to the picture bit allocation processoft the 
virtual buffer processor and the quantisation step size processor for determining said target 
bit rate from the number of bits already used for encoding aiccessive picmres in the 
30 current group of pictures, a target encoding quantisation step size and an average 
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quantisatioii step aze for picmres in the cunent group of pictures; and 

a target encoding quandsotioa ste^ size processor coupled to die bit rate adjustment 
processor and the virtual buff^ processor for determining said target encoding 
quandsadon step size from a predciermined target overall bit rate and die number of bits 
5 used for encoding a preceding group of pictures. 

Brief Descripdon of ihe Drawii^ 

The invention is described in greater detail hereinafter, by way of example only, widi 
10 reference to the accompanying diawmgs, wheran: 

Figure 1 is a block diagram of die constant bit-rare controller based on TM5; 
Figure 2 illustrates the difference between a target bit allocadon and an acmal bits 
consumption at macro block level for one frame (a P-pictuie is chosen for diis case), where 
d) is die virtual buffer fullness at a particular instance; 
15 Figure 3 is a block dagram of die variable bit-raxe encoder widi constant overaU 

bit-rate control; 

Hgure 4 is a block diagram of die constant overall bit-rate conrroller; 
Figure 5 iliustrates how the difference In bit count for the last segmrat is 
redistribuned over die next four segments (e.g. f(m)=l/4); and 
20 Figure 6 Is a flow chan of a VBR algoridrai with constant overall bit-rate cotrtrol. 

Detailed Descripdon of the Preferred Embodnnents 

In a standard MPEG compliant video encoder, a sequence of moving picmres (e.g. video) 
25 is input to the encoder where it is compressed with a user defined target bicrav^ Hie 
target blcrace is set according to the communication channel bandwiddi in which the 
compressed video is to be transmitted* or the storage media capaci^ in which the 
compressed video sequence is to be stored. A ^ical MPEG encoder involves motion 
estimarion/predlctton, Inter/Intra classification, discrete cosine transform (DCT) 
30 computation, quantisation^ zig-zag scanning, variable length coding and rate-control. 
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Several different forms of coding can bs employed depending upon the character of the 
input picnirw, referred to as I-picnires, P-picmres, or B-plcoires. The I-picnires are intra- 
coded pictures used mainly for random access or scene update. The P-plcnires use 
forvard motion predictive coding widi reference to previously coded I- or P- picnires 
5 (anchor pictures), and *e B-picwrcs use both forward and backward motion 
ptedlcdve/interpolative coding widi refarence to previously coded I-or P-picoipes. 
Furthermore, a group of pictures (GOP) is fonoed in encoded order starting widi an I- 
picture and ending with the picnire before the next I-picture in the sequence. 

10 The pictures are paitidoned into smaUer aod non-overiapping blocks of pixel data called 
roacroblocks (MBs) before encoding. Each iiB from a P- or B-picwre is subjected to a 
modon estimanon pfocess in which forward motion vectors, and backward motion vectors 
m the case of a B^iicture MB, are deteraiined using reference picmres from a fifame 
buffer. The target macroblock in the current picmre is matched widi a set of displaced 

15 macroblocks in the reference picture, die macroblock diat best matches die target 
macroblock is used as the predicted macroblock. The posidon of diis predicted 
macroblock is specified by a set of vectors iaiown as inodon vectors, which describe die 
vertical and horizontal displacement between die target and predicted macroblock. For a 
B-piciure, die process is amflar exc^t diere are two reference pictures: anchor pictures 

20 immediately preceding and following die B-picture. 

With die determined motion vectors, roodon compensation is performed where the intraror 
iDter-picnire prediction mode of die MB is first deteraiined according to die accuracy of 
die motion vectors found, followed by generating die necessary predicted MB. I-picmres 
25 are always intra coded while for P and B-pictures, a dedsion on whether intra or inter 
coding will be used (ai macroblock leveO is made depending on which med»d will give 
rise (o a more efficient coding. 

Transformation of the macroblock using a DCT Is dien carried out on the 8x8 pixel blocks 
30 within the macroblock. For intra codmg. die actual picture data is coded, while for inter 
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coding the predicdon error is coded. This is followed by a quantisatioQ process of the 
DCT coefru:ienis which involves a qua^dsatioa matrix and a quantisanon step size. The 
quandzed coefficienis are then lun-Iengdi encoded with variable length codes. 

5 The resultant bit usage and statisticai data are passed onto a ra& control module, wlucb is 
used for ailocadng a target number of bits used co encode each picture and each 
macroblock within the picture. This is an important module in the encoder as it plays a 
major role in maimaining the quality of die encoded picture. 

10 The rate control in MPEG-2 Test Model 5 (TM5) comprises die steps of ailocadng die 
target amount of bits for coding each picnxret deriving the reference quandsadon 
parameier (Qj^ co be used on each macroblock in a piccure, and modulating the based on 
the acdvity masking level of the surrounding blocks of the corresponding macroblock to 
obtain the modulated qiiandsation step size {Mqwznt) used to quantise the macroblock. 

15 

An objective of this ra» controUer is to ensure all picmres maintain a similar level of 
quality. It assumes diat the subjecrive quality of a single coded picture can be qualified 
widi a single number V; described by factor K/Q where AT is a constant pardcular to a 
picture type and 2 is the quannsation seep size for the picture being coded. That is* the 
20 rate controller will try do preserve the following equanoiv 

" Q, Qp 

The subscripts p, b refers to I. P, and B-picture types. The parameters K;, Kp, and 
are experimentally determined constants for all t, P, and B pictures respectively, and 
usually is normalised co the value of L 

25 Figure 1 illustrates a block diagram of a known embodiment of the TM5 rate controller. 
A group-of-pictures (COP) is a collection of one I picmre, some P picmres and B pictures, 
and serves as a basic access unit with the 1 picture as the entry poim co facLHtate random 
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access. The coniroller comprises three levels of processing: a GOP level 1 1 1, a picture 
level 110, and a macrobloclc (MB) level 109. At the stati of every new GOP at the GOP 
level 1 1 U a GOP bit allocation process 100 cotnputes the totd number of bits (R^ 
allocated for the GOP. The vahie of is given by: 

bii rate X W 



picturejnte 



(I) 



5 where bU_ra£e is the target bit rate for encoding the picture sequence. 

piaurejrme is the number of pictures coded per second, and 
N is the total number of pictures coded in the GOP. 

The remaining bits {F) for the GOP is detjemiined ai the picture level 1 10 by a remaining 
10 bits determination process 106. The value of is updated as: 



R^R~S where S is the number of bits UMd by previously coded 

pictures in the GOP, and 
R^R + R^ for anew GOP. 



15 



With the computed value of R. a picnire bit allocarion process 101 at the picnire level 1 10 
dien con^tes a target bit value (7) allocated to the current picmre according to the 
equations below for corresponding I, P or B picture type: 



r = max 



N-X K X picture_rate 

I + — E-^^ 



(2) 



p 



bit rate 



^ N^K^X^ K X picnire _rate 
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- max 



bit rate 



H/C^^ ' Kxpictw^_rate 



(4) 



Represents target biis for the next picture (I,P,B) 
jy^ Nj, Repiesencs the remaining number of pimixies (P3) in the GOP 
5 Represents global complexity measnres and gives a measure of the 

aaual number of bits required to represenc the plErmre (without 
con^ression), and 

Sj, 5p, 5^ ar& the actual t&imber of bits used to code the previous I/P/B 
frame. 

15 K is a constant (e-g. 8) 

After computing the target bits for the picnire, a reference quantisatioa step-size (Qp 
computadon 102 is carried oat at die MB level 109 for each macroblock within tiie 
ptcmre. The value of Qj is computed based on die determined target bit allocanon (7^, 7^, 
20 or and a buffer fullness value (dy). Each of the rhreepicnite types has a virtual buffer 
associated with it and these buffers are updated after coding each macro block of die 
picture t3fpe according to the following equations: 

' ^ MB Cnt 
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T,x(J-\) 
MB Cnt 



(6) 



B^ 



7-1 



MB Cnt 



where d„ is che initial virtual buffer fullness, 

dj is the virtual buffer fullness when coding the/* MB* 
Bj_i is che actual bits consumed up to and including (J-iy^ MB as provided 
5 by a virtual buffer update pxocess 105, and 

MBjOm is the number of MBs in che pictnie. 

Equations (5) to (7) effecuvely track che differences between the actual number of bits 
used and die target bits allocated, and these differences are then added to die respective 
lb virmal buffers which are used to compute This aUows the race controller to connrtjl the 
bits allocadon based on die consumption panem of die picmrc. fi; is computed from die 
buffer fullness via die equadom 

(d; X 31) / r - rfy X constant (8) 
15 where r is a reaction paramfiter ^ 2 x bitjme / picture_rate 

The reaction parameter, as die name implies, is a factor that can control the sensitivity of 
the algorithm from a change in d^. Large r will cause the reacdon to be slower, which 
may cause die target bits and actual bits to differ agniticandy, but it brings about a more 
20 gradual rate of change in bit consumpdon which is favourable for scene changes. On the 
odier hand, a small r causes die controller to be more reactive to changes, giving rise to s 
L-Ioser target and actual bits value, but a faster response also means a less gradual change 
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during scene change which is not desirable. A graph illustrating the difference between 
the target bit allocation and die acmal bits allocated within a frame is shown in Figure 2. 

The value of Qj is ftirther modified by an acdviry masking process 103 to give the 
5 modulated quantisation step size, Mqumu* Basically, the spatial masking ability of the 
macroblock is used to place a correction factor onto die corx^^"* ^* Spatial 
masking ability is die ability to contain noise masked from human visual systems. 
Typically, an area with complex texmrc will have a larger correction factor dian an area 
with single texture, hence, 

10 

MquoTii = Njzaj x Qj (9) 

where Njia^ is die normalised value of macrobtock activiiy level and may have a 
value of betwem 0.5 and 2 

15 

With the computed Mquam, the macroblock coding process 104 is performed where the 
macro block Is compressed according to the MPEG standards. 

20 At dieendof codingapicmre, the bit count S used for coding die picture is used to 

perform a VBV check 107 and to con^>uiB die remaining bits R for the current GOP at die 
remaining bits determination process 106. The VBV (video buffer verifier) is a virtual 
buffer ranulatlng die stanis of die decoding buffer. The VBV check (107) is performed to 
detect any overflow or undertlow of die decoding buffer widi reference to die target bit 

25 rate. 

When coding a picuire sequence widi varying scene complexity, a constant bit rate (CBR) 
encoder is unable to vary the blt-raie according to die scene complexity. This results in 
scenarios wherdjy simple scenes are allocated more bits dian required while complex 
30 scenes arc allocated insufficient bits, and therefore results in a variation of ouq>ut visual 
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quality between scenes of dtfTerent cotry^leniies. 

An embodiment of a moving pictures encoding apparams according to the present 
invention is iliustraied in block diagram form in Figure 3. The encoding apparatus as 

5 illustrated is arranged in four levds corresponding to processing stages in the bit rate 
control process, namely a segment level 313. a GOP level 312, a picmre level 311 and a 
raacroblock (MB) level 310. An input moving picmrcs secpience is encoded in such a way 
that on the average, or at the end of encoding, the output bit rate is close to a user 
definable target overall bit rate {overaU^BR) 320. The input sequence is divided into 

10 segments and groups of pictures (GOP). The purpose of a segment is for monitoring of 
ouqjut bit rate with reference ra the ovefail_BR, and the purpose of the GOP is primarily 
10 facilitate random access. A segment may be defined to include a number of G0P(5) 
depmding on the i^ed in terms of frequency of monitoring output bit rate. Each GOP 
con^jrises at least an Upiciure and optionally one or more P-piciures and/or B-pictures. 

15 Each picture is divided into macroblodcs of pixels for encoding. Hence, a method of race 
control according lo die curr^t invention may contain processes at the segment level 313t 
GOP level 312, picture level 311, and finally macroblock level 310. 

With a new group of picmres, a GOP bit allocation processor 300 computes the number of 
20 bits allocared to the current GOP iR'go^ as follows: 

R . BR X ^ (10) 

^ picttarejrate 

where: 

Is the number of pictures in the GOP. 
picture jme is the number of pictures coded per second, and 
25 BR is a target bit rate. 

The target bit rate BR is determined for eikih picture or plurality of picmres by a bit rate 
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adjustmem processor 306 which is described herdnbelow. A remaining number of bits 
(R-) for die JGOP is determined at the picture level 311 by a remaining bits detetniinaiion 
processor 308, which carries out the steps of: 

5 (a) before eocoiBng the first picture in a GOP, adjusting /i'widi a new J! 
R- + = R'^9tid±sasciBRM'= BR 



(b) 

10 



(c) 



15 



odierwise if the picture to be coded Is not d« first picniie of a GOP. and a new 
target bit rate BR is detennined. dien adjusting R' with the new BR according to: 

/{■ ^ E X {BR - BRJi, and then set BR^ BR 

pictvre_rate 

where N is remaining number of pictures in the current GOP 

and rmioving number of bits used by die last coded picture S fioro the lemaining 
bits value J?', heoce: 

R- = R'-S 



The computed ^' is dien passed to a picture bit allocaiion processor 301 to compute die 
target bit {T} aUocaied to a current picture to be coded. For example, equadons (2)- (3) 
20 and (4) described hereuiabove may be used for diai purpose, widi die parameters K,, 

iV» and piajype being supplied. Note diat the lower limit of bi:_ratef{i*pU3ure_ratey 
is only opuonal and may be adjusted if necessary. 

At die macroblock (MB) level 310, a reference quantisation step-size computation 
25 processor 302 computes a reference quantisation step-size Q, tor each MB using die 
computed target bit allocation T and a bit udlisadon parameter B detcmiined by a viirual 
buffer update processor 305. An erampie of a mcdiod for compudng Q, for die/" MB of 
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the currcm piccure is lepresented by 

fC^ X Z). X picture jrata 



O = — ! = (11) 

where /C, and are constmis (eg. 31 and 2 respecrivety), 
M is the determined target bit rate, 
picture jTQie is the number of coded piccures per second^ and 
5 Dj is a virtnal buffer fullness 

The virtual buffer fullness of the/* MB is determined by: 

^ MB_Cnt 

where Do is an initial bu^r Mlness before coding the current picture, ie. Dj at end of die 
previous picture, 

10 5 is the bit udlisatxon infbrmadon supplied by the virtual buffer update processor 

305, ie. bits used to code die 1" MB to (/-^)'^ MB, 
MB Oxr is the total number of MB in the current picture, and 
Kj 15 a constant (eg. 1), 

15 Three independent current and Initial virtual buffers fiiUncss values {Dj, Df^ D/, Dq, D^^ 
D^) may be maintained for the three piccure types (I-ptcnues* P-picmres, and B-pictures). 
The computed may also be fiirther scaled by an activity masking processor 303 
according to a masking factor determined by the surrounding acdviiy levels of the MB to 
form the fmal quantisation step-size, Mquant, for coding tfie current MB. A method of 

20 mns icin g factor deteoninaiion can be found in the aforementioned MPEG-2 TM5. 

Macrobiock coding (304) is then pertbrmed dd encode the current MB. A macroblock 
coding processor 304 may en^loy. tor exairqjle, methods acconling to the MPEG-1 or 
MPEG-2 video encoding standards. Such encoding methods include necessary motion 
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cotnpensalion. discreie cosine transform, quantisalion with ibe determined quamisacion 
step-size, and run-length encoding wiw variable lengdi codes. The methods also include 
necessary decoding processes such thai motion compensarion can be perfbnned- Tte 
number of biis utilised by the macToblock coding processor 304 to code each MB is passed 
5 to the vimial buffer update processor 305. 

In applications where a maxiinum and/or minimum bit rate must be tnaintalned for 
encoding, a VBV checking processor 307 is uuUsed. User definable maxinium and/or 
minimum bir rates (mar/jnirt Bi?) are input ai 321 to the VBV checker 307. a method of 
10 VBV checking according to the MPEG standards is used lo examine bit utilisation 
infotmarion from the virtual buffer 305, and necessary correctiODS are made to ensure 
compliance and that the ouqjut bir rate is widiin the defined max/min BR. 

At the end of coding a picnire or a plurality of picoiies, bit rate adjustment is ^plied by 
15 the bit rate adjustment processor 306 to provide any necessary correction to die current 
target bit rare BR. The coireciion is based on a target encoding quality provided by a 
target segment quality adjustment processor 309 and a resultant encoding quality of 
previously coded picmre(s) such diat the overall encoding qualities of pictures within a 
segment are relatively close to the target constant. The resultant encoding quality may be 
20 determined by the average value of the reference quantisation step size (ie. average J2i> of 
the previously coded pictine(s>- A method of target bit rate {BR) determination can be 
derived from a rate-quandsatton model as given by: 

BR " current BR + — '--t (13) 

— average 

where current_BR Ls a current estimated bit rate, or 
current_BR = S, + N^x S^, + N,x S». 
25 S„ S^. Si, are bits used by previously coded I, P. and B-pictures respectively . 

A^, /Vj are ratal number of P and B-pictures in the current GOP . 
average jQ, is the average value of Qj of previously coded picture(s) 
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target Jl' is the target encoding quality or target value of Q;, 

may be a constant, or a factor of previous BRy max_BR, or curreru_BR, and 
may also be separately dccennined for 1, and B-pictuie xypes. 

5 Maximum and/or minimum bit rates can be applied to the detennined BR according co 
appUcarion requirements. The max/min BR input at 322 are used as given by: 

If iBR > max_BRi, then BR = max_BR 
if {BR < min_SR), then BR = minJR, 

10 

It is also possible CO make use of the target J2s ^ die macro-block level to increase 
efficiency of racotfing. Basically, the target J2^ is used by the reference quanusaiion step- 
size compuialion processor 302 as a lower limit of the ouqiut reference quantisation stqj- 
size Qj such that vhen diis target (quality) is reached at the MB level, bits are saved for 
15 future encoding imraediaiely. In dris case, the output reference quantisaaon step size 
be set according to: 

if (12/ < target J2i). then = target J^^, 

20 The target bit rate BR is adjusted continuously with reference to a fixed target encoding 
qualiiy within each segmenL In mm at the beginning of each segment, the target 
encoding quality is adjusted so that a target overall bit rate is achieved. A segment may 
contain a few groups of picmres depending on the need in terms of frequency of 
motuioring output bit rate. A new segment may also be defined by a scene change 

25 detectable by any conventional scene change detector with a given range of dme. 

At the onset of a new segment, the target segment quality adjustment processor 309 
executes a check on the overall bit-rate based on bits usage sutd makes any necessary 
adjustments to the target encoding quality for the bit rate adjustment processor 306 so thai 
30 the overall bit-rate converges id a user definable target overall bit-rate 320 (overall^ BR). 
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An example embodiiMnt of a constant overall bit raie conrroller implementing the target 
segment quality adjusmient process according to the present invention is illustrated in 
block diagram form in Figure 4, The bit couni difference between the actual and target bit 
counis {bits ji^ for coding of a previous segment is calculated by a bits difference 
5 co^^]lJt3don processor 401, utilising the steps of: 

a) obtaining the actual bits {biis_segmem} used for coding the previous segment 
according to the input bit udlisadon of pictures (5) 400 in the previous segment, 
and 

10 

b) conqjuting die value of Wtr jfij^based on a corresponding target segment bit rate 
406 (segmem^BR) for the previous segment, according to; 

seement BR r N,^,,^^ 

bitsr Off = ~ = - bits^segment (14) 

" picture jxxte ~ 

where Nj^^„ \s the number of coded pictures in the previous segment. 

1 5 The bit count difference (bUsji^ is then redistributed by a bit difference distribution 
processor 402 over the next fc mimber of segments using a bit distribution function* J{ni)^ 
expressed as: 

deltajrits^ =J{m) x biisjSff OS) 

20 

where m = 1 k, 

delta J7its„ is die bits difference disDributed to next segmenL 

25 For an example case of ifc=*4 zndJ{m)^Vk, Figure 5 illustrates how die bit count 

difference (bitsjiiff) of an encoded segment is distributed over the next 4 segments. The 
period of k segments used for bits compensation is referred to as an adjustment interval. 
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A ddia bit-raie computation processor 403 (Figure 4) accumulaies all bir differences 
{delta J^Us) distributed from previously encoded segments to the curreat segment to be 
coded, and computes a delta segment bit-rate {Asegmenj^BRi based on ria: accumulated 
delta bits and die number of pictures in die current segment co be coded. The delta 
5 segment bit-rate and a user definable target overall bit-raie (overall JR) input at 408 are 
used by the target segment BR adjustment processor 405 to derive the tai^ei segment bit 
raiB {segment BRi 406 for die current segment. The value of segment_BR can be 
expressed as: 

10 segment^BR = overall^BR + asegmem^BR 

A new target encoding quality {target 407 for encoding of die curreat segment is dien 
determined from the target segment bit raie usmg a BR-Q| modelling processor 404. The 
BR-Q, tnodelling processor may operate, for example, according »: 

target _0, = target _Q- ^ AO^. (18) 



15 where targetjQ) is the target ^ of the previous segment, 

segment _BR' is the target segment bit rate of die previous segment, and 
AT, is a constant which can be experimentally determined. 

I 

A maximum limit may be placed on d:ie determined LQ^ so that there is no drastic change 
20 in output qualiry from one segment co another. ' 

I 

A now Chan for a process of variable bit rate (VBR) 'encoding with constant overall bit- 

i 
I 
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nite control according to an embodiment of die iitventioii is illustrated in Figure 6. 
Initialisation of predetermined paramecers is first canied out at seep 600. Then* at step 
601 riic process determines whether processing is at the stan of a new group-of-picwres 
(GOP) or not- Where anew GOP is dcterminedp step 602 is carried out by updating the 
5 bit allocation for the new GOP. This may involve, for cwinple, conqmiaiion of the GOP 
bit allocation R'^ according to Equation (10) described hereinabove and accumulating to 
. the remaining bit value R' to give the R' for the new GOP. 

For each picmre in the ament GOP, a target bit allocation value T is determined at step 
10 603, and this may be oo^^wIed according to Equations (2). (3) and (4), for example. 
Then, for each macroblock: in the picture, a reference quantisation Soq> size Q is 
detemnned using the computed target bit allocation 7, such as by the process leptesemed 
by Equations (U) and (12). Actzviiy masking may also be included m this step. The 
macroblock of the picture is ttien encoded at step 60S using the conqiuied quantisation step 
IS size» and steps 604 and 605 are treated for all of the macroblocks in the picture until the 
end of the picture is (tetennined at step 606. 

When the end of die sequence of moving pictures which Is being encoded is reached, this 
is deiemuned at step 607| which terminaies the process at step 611 upon that occurrence. 
20 Otherwise, the process continues to step 608 where It is determined ^K^ther die end of tte 
current segment of pictures has been reached. 

When the end of a segmeoi of picmres is reached and processing of a mw segmem about 
CO begin, the target encoding quality is adjusted at step 609. This is perfomxed by tirsdy 

2S conq)utLiig the difference between the number of bits aliocaied for coding the previous 
segment and the actual number of bits used in coding that segmem. such as by ttie process 
represented by Equation (14). This quanticyt bitsji^, represents extra bits which are left 
over from the previous segment of pictures, and may be distributed for use in encoding die 
ensuing picmre segments. Tlie Lett over bits bUsjliff^t distributed for use over one or 

30 more segments according m a bit distribution limcuon, an example of which is described 
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in connection with Equadon (15). b essence, die left over bits from the previous segment 
are divided Into a plurality oft, preferably equal, amounis and allocated to the following k 
segments for encoding with. The dividends allocated from all of the t previously 
processed segments are accumulated a«d used to determine a change in segment bit rale, 
5 ^segment BR, according to the accumulated bits difference and the number of pictures in 
the segment to be coded. This can then be used to compute an allocated bit rate for the 
segment to be coded according to Equation (16). Finally, a target encoding quality, 
target J2^, can be computed according to Equations (17) and (18), for example. 

.10 If the end of a segment has not been reached at step 608, or after the target quality 
adjustment of step 609, the target qualify and the actual quality of encoded pictures is 
compared, and a new bit rate for encoding die next picmre is computed based on die 
difference- This step can be carried out as described in relation to Equadon (13), for 
example. The procedure dien returns to step 601, described above, 

15 

In summary, embodiments of die present iirvendon provide mediods and apparanis for 
encoding moving pLcmres with a variable bit rate whilst maintaining a consistent output 
encoding quality according to a determined target quality. The target quality is adjusted at 
the beginning of every moving ptcoiies segment according to a bit distribution fimcnon to 
20 ensure an overall bit rate thai meets a defined target- Furthermore, the segment based bit 
distribuuon function provides smooth and flexible tnodularion of the encoding qualicy. 
The method can be implemented ai low cost and with the ability to encode an input 
moving piccutes sequence in one-pass at real-lime. 

25 U will be readily apparent to those of ordinary skill In the art that the foregoing detailed 
descripdon of the present invendon has been presented by way of example only, and is not 
intended to be coiuidered limiting to the invendon as defined in the claims appended 
hereto. In pardcular, it is envisaged that numerous variations to the embodiments as 
described can be made without departing from the spirit and scope of the invention. 

30 
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Throughout this speciflcaiion and the claims which follow, unless the context requires 
otherwise, the word -comprise^, and variadons such as -comprises" and 'comprising"* 
wUi be understood co imply the inclusion of a staled integer or step or group of integers or 
steps but not the exclusion of any other integer or step or group of integers or seeps. 
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VBV 

VBR 
5 CBR 

MPEG 

DCT 

GOP 

MB 
10 Q 

C/ 

(2. Q«. Of 

15 picawej-ate 
N 

S 

20 r,, Tp, 

Bh 
25 MB Cm 

r 

Mquant 
overall_BR 
30 BR 



video buffer verifier 

variable bit race 

constant bit raze 

Moving Picture Experts Group 

discrete cosine transform 

group of pictures 

macroblock 

quandsadon parameter (picture quality) 

quantisation parameter for msijjrDblocIc J 

quamisation parameters for I, B and P type pictures 

number of bits allocated for encoding a group of pictures 

target bit rate for a picture sequence 

number of pictures coded per second 

total number of picmres in the group of pictures 

remaining number of P3 pictures in the group of pictures 

remaining lamiber of bits for encoding a group of pictures 

number of bits already used in coding a group of pictures 

target number of bits for coding next I, P» B type picture 

global complexity measures for I, P, B type picture 

virtual buffer fullness when coding the/* macroblock 

inidal virmal buffer fullness 

actual bits used up to and including 0'-^)**" tnacroblock 

number of macroblocks in die picture 

reaction parameter {=2x bitjme I picture jme) 

normalised macroblock acdvlty level 

modulated quantisation step size (= t^i^t^j x Q-^ 

detlnabie target overall bit rate 

target bit race 
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B bii utilisation intbrmation (eg. bics used to code previous MBs in picture) 

curreni_BR currenc esdmaied bit raw 

ayerage_Qs average vah» of quantisarion pananeter for previously coded pictures 

target (2y quantisadon parameter value for target encoding quality 

5 max BR tnaximutn permined bit rate 

min^BR minimura permitted bit rate 



min^BR minimura permitted bit rate 

bUs diff difference between actual and target bits used in coding 
segnteni^BR target segment bit rate 
bits segment acmal number of bits used in coding previous segment 
10 ^jrgmtfw number of coded pictuies In previous segment 

delta J7its„ number of difference bits available to next nr** segment 
J[m) bits distribution funcrion 

^segment JBR available difference in segment bit raie 



previous segment 
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Qaims: 

1. A method for use in a moving picmres encoder tor encoding a sequence of 
segments e^h having at least one image* comprising the steps of: 
5 a) decermining an overall target bit rate for encoding the sequence of images; 

b) detemilning a bit allocation and target quantisadon seep si2e for encoding a 
first segment on die basis of a segment target bit rate caiculaied using said overall 
target bit rate; 

c) encoding said first segment using a variable bit rate encoding mediod 
10 according DO the taiget quantisation step size; 

d) determining a diffemice between die number of bits used to mcode said 
first segment and said first segment bit allocation; 

e) distributing said difference for use in encocting at least one subsequent 
segment to determine a subsequent segm^ bit allocation; 

15 f) determining a new target quandsanon step size for encoding a said 

subsequent segment on the basis of a new target segment bit rate calculated using 
said segment target bit rate and the distributed difference; and 
g) encoding said subsequ«u segment using a variable bit rate encoding method 
according co the new target quantisadon step size; 

20 wherein variable bit rate racoding is employed for encoding picmres within a 

segment whilst m^ntaining a substandally constant bit rate ov^ said sequence. 

2. A method as claimed in claim U wherein die steps d) to g) are carried out 
Iteratively using the tumiber of bits used to encode the subsequent segment and the 

25 subsequent segment bit allocation for determining said difference. 

3. A method as claimed in claim I or 2, wherein each segment comprises at least one 
group of picmres having an I-picture and optionally at least one P and/or B-picoire, 

30 4. A method as claimed in claim 2 or 3, wherein the ditTerence between die number 
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of bits used to encode the first segment and said first segment bit allocation is detennined 
according to: 

overall BR x /C^, 

bits diff = = - bttsje^ent 

" picture j^te 

where: 

bits diff is said (tiffbr^e, 
5 overoU^BR is the overall target bit rate, 

N^g^^ is the number of coded images in the first segment* and 

bits_segment is die actual number of bits used to encode the first segment. 

5* A method as claimed in claim 4, wherein said difference is distributed according 
10 to: 

delta_b[ts^ =J{m) Tibitsjliff 
where delta Jfit5„ is the bits difference distribuied to next in* segment m the sequence. 
m - 1,...,*, 

it is a positive integer, and 
15 J{m) is a bit distribution fiincuon, where I^fi/n) — L 

6- A method as claimed in claim 5, where /(w) - 

7* A method as claimed In cUim 5 or 6, wherein the steps d) to g) are carried out 
20 iieraiively using die number of bits used to encode the subsequent segment and the 
subsequent segment bit allocation for decemiining said difference. 

8. A method as claimed in claim 7, wherein the new target quannsaiion step size is 
calculated according to: 

no = large, C r (^^«"^ SR - ^entBPTj 
* — K X segment _BR 

25 
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target^ = target^ + AO 

where targer_Q is ihe new target quaitdsaiian step size, 
segment_BR is the new largec bit rate, 

target jQ' is the cargei quantisauon step size of the preceding segmeni, 
segmem_BR' is ihe target segment bli ra» of the preceding segment, and 
5 JiTis aconsonu 

9. A method as claimed in claim 7 or 8, wherein for each subsequent segment die 
difference between the number of bits used to encode the segmeni and the segment bit 
allocation is determined according to: 

segment BR x 

bitsjiiff = — = - bits^segment 

picture_rate ~ 

10 where: 

bit5_d^ is said differ^e, 

segment_BR is the segment target bit raie, 

^2zpM is number of coded images in the segment, and 

bits_segmeni is the actual number of bits used to eticode the segment. 

15 

10. A method as claimed in claim 9. wherdn said difference is distributed according 
to: 

delta Jfits„ —J{m) x bitsjt^ 
where delta_bits„ is the bits difference distributed co next segment in the sequence. 

20 m = 1 A. 

is a posiuve integer, and 
Jim} is a bit distribudon funcdon, where S^/[m) = 1. 

11* A mechod as claimed in claim \0t where ^/n) = l/fc. 

25 
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12» A method for encoding moving pictures in a moving picoires encoder wherein a 
sequence of images are provided as Inpxu the sequence of images comprising a plurality 
of segments each having a pluraliiy of images, the method including: 

a) determining an overall target bit rate for encoding ihe sequence of images; 
5 b) , maintainiag a distribution record of bits irom ac lease one previously 

encoded segment allocated for use in encoding at least one segment to be encoded; 

c) deteanining a target segment bit rate for a segment of the sequence of 

images on the ba^ of doe overall target bit rate and a bit rate change calculated 

from the cone^tuling allocated bits &om the distribution record; 
to d) determining a target segmetit encoding quality from the target segment bit 

rate, a preceding target segment bit rate and a preceding target segment encoding 

quality,; and 

e) encoding the images of the segment according to the target segment 
encoding quality "™g a variable bit rate encoding tTThnigue taking into account 
15 scene complexities of the images m the s^mem; 

whetein mf^ ip^ir'^E said distribution record includes detencining a difference 
betw een the number of Ints used to encode a particular segment and the number of bits 
allocated for encoding tbe particular segment on die basis of the target segment encodmg 
quality. 

20 

13. A method as claimed in claim 12> wherein steps b) to e) are carried out iteratively 
for said sequence of segments. 

14« A metiiod as claimed in claim 13, wherein each segment comprises at least one 
25 group of pictures having an I-plcture and optionally at least one P and/or B-picture. 

15. A method as claimed in claim 12, 13 or 14, wherein die target segment encoding 
quality is calculated accord'u^ to: 



^ K X segment JBR! 
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eorggf O - ftargg/ Q AQ 

where target Ji is the target segment encoding qualiry, 
segmem_BR is ihe target segment bit rate, 
target JQ' is the preceding target segment encoding quality* 
segmemJSR' is the preceding target segment bit rate, and 
3 Kisz constant- 

16. A method as claiined in claim 15, wherein the difference between the number of 
bits used to encode a panicular segment and the number of bits allocated for encoding *e 
particular segment is determined according to: 

segment BR x N^^^^^ 

bits m = = - bits_segm€nt 

~ picture jtite 

10 where; 

bUs jliff is said difference, 
segmemJSR is the segment target bit rate, 

is the number of coded images in the segment, and 
bits^segmem is die actual number of bits used m encode the segment. 

15 

17. A mediod as claimed in claim 16, wherein die allocarion of bits in die distribudon 
record is calculated according to: 

delta J>U5^ ^Jim) x busjBff 
where deta bits^ is the bits difference ailocaied to next segment in die sequence, 
20 m = 

i: is a positive imsger , and 

J{m) IS a bit distribudon funcdon, where E^/m) = t 
IS. A method as claimed in claim 17, where^r^i) - 1^*:- 

25 
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19, A method for conaolling bit allocadon in a moving plcoires encoder for encoding a 
sequence of images comprising a plurality of segmcnis each having a plurality of images, 
che method including, for each segment: 

determining a difference between a number of bits used for encoding a previous 
5 segment and a number of bits allocated for encoding the previous segment; 

calculating a bits distribudon from the determined bits difference and a 
predetermined disoibution function; 

calculating a bit rate change from the bits distribution and a predetermined number 

of images in the s^ment; 
1 0 calculating a target segment bit rate from che bit rate change and a predetermined 

target overaU bit rate for the sequence of Images; and 

determining a target segment encoding quality from the target segment bit rate. 

20. A method as claimed in claim 19, wherein the difference berween the number of 
1 5 bits used for aicoding the previous segment and the number of bits allocated for encoding 
the previous s^ment is dercrmined accanding to: 

bits diff = — - bttsjegment 

" picture 

is said difference. 

is che previous segment target bit race, 
is the number of coded images in the previous segment, and 
is the acmai number of bits used to enccxle the previous segment. 

21. A metfiod as claimed in claim 20, whereiti the bits distribution is calculated 
according to: 

25 dellajjiis^ =Af^) t bitsjSiff 

where deba_bus„ is the number of bits diiference allocated to next segment in the 
sequefKe, 



wbexc: 

biisjiff 
segment_BR 

20 

bits segment 
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Jt is a positive iniegcrp and 

fjn) is a bit distribution fiincuoa, where ^^fipi) - 1- 
5 22. A method as claimed in claim 2U wtiere/^/n) = 1/^. 

23, A mediod as claimed in any one of claims 19 to 22, wherein the target segment 
encoding quality is calculated according to; 

Ag = target a x ^ ^^„,jp. 

target _0 = target^' + AQ 



where rflr^€r_Q is the target segment encoding quality, 
10 segment^BR is the target segment bit rate, 

target Ji* is the previous segmttit target segment encoding quality, 
segmeru^BR' is the previous segment target segment bit rate, and 
/iT is a constant- 

15 24. An encoding quality adjustment processor for generadng a target segment encoding 
quality value in a moving pictures oicoder for encoding a series of segments each ha:ving 
at least one image using a variable bit rate encoding scheme whilst maintaining a 
substandally constam overall bit rate, comprising: 

a bits difference computation means coupled do receive a segment encoding bit 

20 utUisadon value and a target segment bit rate and generate dierefrom a bits difference 
value representing a ditference in bits allocated and bits used for encoding a segment; 

a bits distribudon means coupled to the bits difference computation means for 
computing at least one bits distribution value from Ae bits difference value and a 
predetermined distribution function: 
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a bit raie difference computaiion raeaiTS coupltjd to the biis disuibution means for 
computing a segment bit raw difleience from the ai least one bits dismbuticin value and a 
predereimined number of images in a segment; 

a target segment bit rate adjusnnent means coupled to the bit rate difiPsrence 
5 computation means and the bits difference computation means for computjng said target 
segment bit rate ftom the segment bit taie difference and a predetermined target overall bit 
rate for the sequence of segmenis; and 

an encoding quaUiy computation means coupled lo the target segment bU late 
adjustment means for computiag a target segment encoding quality value from said target 
10 segment bit rate. 

23. A moving pictures encoder comprising: 

a coding processor for encoding picmre data based on macroblocks according m a 
quandsation step size; 

15 a viimal buffer processor coupled to decoding processor for tracking a number of 

bits used for encoding successive macroblocks in a picmre and a number of bits used for 
encoding successive picwres in a group of picmies; 

a quaniisanon step size processor coupled to the coding processor for detcimiiang 
said quannsaiion step size fnim a target number bits allocated for a picture and the number 
20 of bits already used for encoding macroblocks in that picmre; 

a picmre bit allocarion processor coupled to the quannsarion step aze processor for 
determining said target number of bits allocated for a picture from a target bit rate and the 
number of bits already used for encoding pictures in a cuireni group of picwres; 

a bit taw adjusnnent processor coupled to the picmre bit allocadon processor, the 
25 viimal buffer processor and the quanrisadon step size processor for determining said target 
bit rate from the number of bits already used for encoding successive picwres In the 
current group of picwres, a target encoding quantisation step size and an average 
quandsation step size for picwres in the current group of picwres: and 

a target encoding quandsation step size processor coupled to the bit rate adjusonent 
30 proc«ssor and the vlraial buffer processor for determtnLng said target encoding 
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quantisation seep size from apredeiermined tirget overall bit rate and the number of bits 
used for encoding a preceding group of picwres. 
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